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I. INTRODUCTION 



In the last few years our knowledge of the flavor struc- 
ture of leptons has been strongly improved, thanks to 
neutrino oscillation experiments L3- Ld- Lll- Li LJ| - The hi- 
erarchy between the solar and atmospheric mass squared 
differences is given by a factor Am^. ol / Am^ tm w 0.035. 
This translates into a very mild hierarchy between two 
mass eigenstates, vnijrnj, > 0.15. The mass m\ can be 
much smaller or almost equal to the other two, depend- 
ing on the degree of degeneracy of the spectrum. The 
corresponding hierarchy parameters for charged leptons 
are TO M /m r w 1/20 and m e /m M w 1/200. The mixing 
between second and third generation is almost maximal 
(sin 2 2#23 ^ 0.9), that between the first and the second 
is large but non-maximal (sin 2 2#i2 ~ 0.8) and finally 
sin 2 26*13 ;$ 0.15. Also in the quark sector the hierarchy 
between first and second generation masses is stronger 
than between second and third, but the mixing pattern 
is reversed: is much smaller than the Cabibbo angle 

q 
°\2- 

In the search for the underlying flavor symmetry dic- 
tating the relations among fermion masses and mixing, 
one has to understand what features of the data are di- 
rectly connected with the symmetries of the mass matri- 
ces and what are second order effects. In this paper we 
take the point of view that the first step should be to 
explain the almost maximal atmospheric mixing. This 
angle is at present poorly constrained (37° < 6*23 < 53° 
at 90% C.L.) and next generation experiments will not 
improve this bound significantly Q. However, there are 
already many indications that such a large mixing re- 
quires a specific mechanism for its generation, being #23 
exactly maximal or not: 
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• Present data allow for several structures of the Ma- 
jorana neutrino mass matrix M v , depending on the 
mass spectrum and CP-violating phases. In most 
cases, the large atmospheric mixing is imprinted in 
the dominant structure of the matrix, the unique 
exception being M v « m t [1,0- 

• In the case of normal mass hierarchy, which is the 
one closer to other fermion mass spectra, the neu- 
trino mass matrix is dominated by the /i/i, /ir and 
tt entries [lOj, because the heaviest mass eigen- 
state is almost equally shared between and v r . 

• Since neutrinos and charged leptons belong to the 
same SU(2)l representation, one should naively ex- 
pect a flavor alignment between them (that is a 
cancellation between the left-handed mixing in the 
two mass matrices). The alignment is observed, in 
fact, between down and up quarks (#f 3 ~ 2°). No- 
tice that this argument is roughly independent from 
the Majorana nature of the neutrino mass matrix. 

• The mixing can be enhanced through Renormal- 
ization Group running from high energy to elec- 
troweak scale (see [Til Il2j and references therein). 
This works only for quasi-degenerate neutrino 
masses and in general the enhancement is efficient 
only for the solar mixing. The unique exception is, 
once again, the case M v m mot, but the pattern of 
radiative corrections has to be chosen ad hoc [Tflj 
or the initial conditions at the high scale have to 
be fine-tuned 0E3. 

In the context of the seesaw mechanism for the genera- 
tion of small neutrino masses, the possibility of a dynam- 
ical origin of the large mixing has been investigated. In 
the case of type I seesaw [la, H3, Ho, , conditions have 
been found for a 'seesaw enhancement' of lepton mixing 
[HiJ. Specific correlations between the neutrino Dirac 
mass matrix and the associated right-handed Majorana 
mass matrix are required. Recently it has been pointed 
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out [221 th at, in unified models with dominant type II 
seesaw |23l l24l l25t l2q , maximal atmospheric mixing can 
be related phenomenologically with b — r Yukawa unifi- 
cation. In both cases, it seems to us that an underlying 
symmetry is still required to enforce #23 to be almost 
maximal. In particular, we will show that the resulting 
value of the mixing at low energy depends crucially on 
which heavy fields give the dominant contribution to M v 
and what are their flavor symmetries. 

Many flavor models for leptons have been devel- 
oped based on discrete or continuous symmetries, both 
Abelian and non-Abelian. The most popular class of 
models is based on U(l) flavor symmetries and the 
Froggatt-Nielsen mechanism [2^. A review of U(l) fla- 
vor symmetries in the lepton sector and references can be 
found in j2^| . Other models make use of the Abelian dis- 
crete symmetries Z n [2^, m, El EM EH • However, min- 
imal realizations of Abelian symmetries encounter some 
difficulties in reproducing data. In section[H]we will com- 
ment on the present status of U(l) and Z n flavor sym- 
metries in confronting neutrino oscillation data and in 
particular the large atmospheric mixing (see also [3). 
To overcome at least some of the problems of Abelian 
symmetries and obtain greater predictiveness, a variety 
of non-Abelian symmetries have been used, both discrete 

mm mm and continuous mmm 

In section Hill we will show that the basic features of 
lepton masses and mixings (and also those of quarks) can 
be traced back to a minimal realization of the smallest 
non-Abelian group, S3, i.e. the permutations of three 
objects. This group was first used for flavor physics in 
|42j and it has been a naly zed, for example, in few other 
papers m> El EE EJ EI3 • The less minimal possibility 
of S3L x S3R symmetry was first considered in 01 an d 
subsequently exploited in 0,113,11^1112,113] Motivations 
for the use of 63 flavor symmetries in supersymmetric 
models can be found in [54(: in particular the SUSY 
flavor problem can be relaxed. 

In our approach, the choice of £3 is minimal since we 
have to deal with three generations of fermions and we 
need at least one 2-dimensional irreducible representation 
(irrep), in order to connect the two generations which 
maximally mix. The group S3 has, in fact, three irreps: 
1,1' and 2. It turns out that the existence of two in- 
equivalent 1-dimensional representations is crucial to re- 
produce fermion masses and mixing. We will analyze first 
the lepton 2 — 3 sector (section fill A\i . then we will extend 
our model to include the first generation (section IIII B[l . 
finally we will consider the quark sector (section IlII C[l . 
In section lrvl we summarize our results and discuss merits 
and limits of the model. 



II. A CRITICAL VIEW OF ABELIAN FLAVOR 
SYMMETRIES 

Let us discuss first continuous Abelian symmetries. 
The most often considered U(l) charge in the lepton 



sector is L e — — L T , introduced long ago in connec- 
tion with pseudo-Dirac neutrinos |55| . In fact, this non- 
standard lepton charge induces naturally large mixing. 
However, the predicted phenomenology is no longer com- 
patible with present data, at least in minimal realizations 
of the flavor symmetry. Let us review the basic reasons 
for the tension between L e — — L T and experiments. 

Let us call qx the {/(l)-charge of the field X. In lead- 
ing order, only the couplings with field charges adding 
up to zero are allowed We denote with (y a l a ) T 

the isodoublet of left-handed Weyl spinors with charge 
and —1, respectively, and with l c a the isosinglet part- 
ners, which are left-handed and have charge +1. Since 
Qe,v e = 1 and q^ v T ,u r = — 1, the matrices of ?7(1)- 
charges relevant for the neutrino and charged lepton mass 
matrices M v and Mi are 

( 2 \ 

Quu = -2 -2 , 

^°- 2 ^ x (l) 

Qll" = -l + q e <= -1 + q^c -l + q T c 

\-l + q e c -l + q M c -l + q T <-J 

where the charges of e c , fi c , t c are not yet assigned. 

The structure of the mass matrices depends on q^, 
where 4> is the Standard Model Higgs isodoublet. Only 
two viable neutrino mass matrices can be obtained via 
the usual five-dimensional operator uvcfxp, for q^ = and 
q^, = 1 respectively: 

/0 a b\ / \ 

Ml = [a , M? = c d , (2) 
\b J \ d e J 

where a and b (c, d and e) are of the same order. It is 
easy to check that Ml corresponds to inverted mass hi- 
erarchy with eigenvalues 0, ±v?+F, with an order one 
23-mixing (tan# = ci/b) and a maximal mixing between 
the two mass degenerate states. The matrix M„ corre- 
sponds to normal mass hierarchy with one zero eigenvalue 
and order one mixing between the two massive states. 

As far as charged leptons are concerned, q T c should 
be chosen to allow a non-zero 33-entry in Mi, in order 
to generate the dominant r mass. Then, it is straight- 
forward to show that the structure of MiMj is given by 

[AO \ 
MiM\ = B C . (3) 
\ C* D J 

The parameters B,C,D are of the same order, while A 
can be suppressed by the choice of q e " and q^ . In any 
case, the contribution of charged leptons to the mixing 
amounts only to an order one 23-mixing. 

Therefore, in both normal and inverted hierarchy 
cases, the 23-mixing can be large but it is not naturally 
maximal. Moreover, if all order one parameters are taken 
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to be really close to 1 (thus leading to m 2 <C m 2 . in M/M/ 
and to Am 2 ol <C Am 2 tm in M^), the 2 — 3 mixings are 
almost maximal in the two sectors, but they cancel each 
other almost completely! The 12-mixing is maximal in 
the case of inverted hierarchy and zero in the normal 
hierarchy case, both in disagreement with experiment. 
Symmetry breaking corrections to these predictions are 
usually small and do not reproduce data easily. 

The problem to generate maximal atmospheric mixing 
is common to all minimal models with U(l) flavor sym- 
metry. The assignment of the same charge to (i and r 
isodoublets leads to a cancellation between large mixing 
in neutrino and charged lepton mass matrices. Models 
with inverted hierarchy can hardly explain the devia- 
tion of solar mixing from maximal. Models embedded 
in Grand Unification theories usually favor normal hier- 
archy, but the smallness of first generation masses tend 
to prevent a large mixing in the 12-sector. 

Let us discuss now the Abelian discrete symmetries 
Z n . In this type of models the fields transform under Z n 
via discrete rotations, given by 1, cj, u> 2 , . . . , u;™" 1 , where 
lu = e 2 W™ is the n-th root of unity. A coupling among a 
given set of fields is allowed by the symmetry only if the 
product of the corresponding rotation phases is equal to 
one. 

In the case of Z2, one can assign muon and tau leptons 
to the representation with phase u = — 1 and assume 
that the electron leptons are Z2 invariant. It is easy to 
check that the same problems are found as in the case 
of L e — — L T symmetry: order one 2 — 3 mixings are 
generated in both neutrino and charged lepton sector and 
they tend to cancel each other; moreover the other two 
mixings are zero in the limit of exact Z2 symmetry. 

The situation is better in the case of Z3 . One can as- 
sume e, /i, t isodoublets to transform as 1,lu,lu 2 respec- 



tively, where w = e 



2iri/3 



Then the analog of Eq.Q is 



solar mixing can appear easily from subleading correc- 
tions. However, the neutrino spectrum has a very un- 
pleasant feature: in leading order the atmospheric mass 
difference is zero while the solar one is not. 

This drawback is generic to all models where the large 
atmospheric mixing is obtained via dominant off-diagonal 
entries in the 2 — 3 sector of the neutrino mass matrix. 
In fact, phenomenology tells us that the two maximally 
mixed states are associated with the largest mass split- 
ting. There are two ways to go round this difficulty. 
The first is to consider models predicting at leading or- 
der three degenerate neutrinos. In this case both mass 
splittings are considered small perturbations while the 
maximal 2 — 3 mixing is an outcome of the symmetry. 
A good example is the A4 model [37| 1 which predicts the 
matrix (J5J with a — 6. The second way is to construct the 
maximal mixing without dominant off-diagonal entries in 
the 2 — 3 sector of M v . The advantage is that both mass 
differences are naturally non-zero. We will pursue in the 
following this second way. 



III. THE S3 MODEL 

The S3 group has six elements divided in three conju- 
gacy classes: the identity (e), the cyclic and anti-cyclic 
permutations of three objects (g c and g a ), the three inter- 
changes of two objects leaving the third fixed (gi, (72, 53)- 
Two independent 1-dimensional irreps are possible, de- 
pending if the action of all six elements is trivial (1) or 
if gi (i — 1,2,3) act with a change of sign (1'). We will 
call "odd" S3 singlets the fields transforming in the 1' 
representation. The third and last irrep is 2-dimcnsional 
(2). Since we deal only with complex fields, we have the 
freedom to choose a complex realization of the 2 |5(i| . 
which leads to very convenient tensor product rules: 





where 



are 1, 



(4) 



depending on the Z3 as- where lu = e 2l7r / 3 . Notice that, in this realization, 




(6) 



signment of e c , /i c , r c and <f>. Whatever the assignment of 
these fields, it is clear that only one element in each col- 
umn of the charged lepton mass matrix is allowed. This 
means that this matrix is diagonal up to an unobservable 
permutation of the fields e c , r c . Therefore all the mix- 
ing comes from the neutrino sector and the only viable 
dominant structure is 



lp2 



e 2 



4 
4 



e 2 



(7) 



a 
M v = I 6 
6 



It is trivial to show that 1 x 1' = 1', l'x 1' = 1, 2 x 1 = 2 
and 2 x 1' = 2. Finally and most importantly, one has 
2x2 = 1 + 1' + 2, where, if (ipi ip2) T and (y?i up 2 ) T are 
S3 doublets, then 



(5) 



where a and 6 are of the same order. A maximal mix- 
ing in the atmospheric sector is generated and a large 



01992 + 
TpHp 2 - lp2<fil 



4lV2 



e 2 



-4<P2 
4f2 



e 1 , 

G 1' 



(8) 
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With these few ingredients one can construct easily S3 
invariants, once the assignment of Standard Model fields 
to S3 irreps is given. 



A. The [it sector 

Let the following fields transform under the 2 irrep of 



S, 



$2 



(9) 



where L a = (y a l a ) T ', = (<t>° <t> { ) T and & = 
£i) T are scalar isotriplets. Let us assign also 



if e 1 , t c g 1' . (10) 

The invariants relevant for lepton masses are 

(t0? + /i^K , (t0° - ^° 2 )r c , i/^tf + v r v T t% . 

After electroweak symmetry breaking, the neutral scalar 
fields take VEVs < 0° >= Vi and < f° >= «i, so that 



M, = 



A«2 -/2U2 

1 / 1 -1 \ /" /l(«2 + «l) hi^l - V 2 ) 
2\l 1 )\fi(vi-v 2 ) f 2 (v 2 +Vi) 

Ml 
f 3 u 2 



(12) 

where /j are dimensionless coupling constants. 

It is apparent that, if V\ = v 2 = v (and u\ 7^ u 2 ), max- 
imal mixing is generated. Indeed the condition v\ = v 2 
minimizes the S3 invariant scalar potential (see section 
IIII A If) . The lepton masses are given by m M = \/2fiv, 
m T = \/2f 2 v, Am 2 tm = fl(u 2 — \ui\ 2 ) (notice that all 
complex phases can be rotated away but a Majorana 
phase in the neutrino sector, which we can think as as- 
sociated to Mi). The deviation from maximal mixing can 
be easily computed as 



7T Vl - V 2 

723 - 7 ~ ; 

4 vi + v 2 



(13) 



A comment is in order about different contributions to 
the neutrino mass matrix. Since the VEVs of £j have 
to be seesaw suppressed (see section ITlI A lfl . in general 
a comparable contribution to neutrino masses can come 
from the non-renormalizable operator L a L(3<bi3>j/Mn, 
where Mr is the seesaw scale and $i = ia 2 $>* — (</>f — 
4>° i *) T ■ Taking into account that (3> 2 $i) T G 2, one finds 
the following S3 invariants: 

The first invariant can be mediated, at the seesaw scale, 
by the triplets and its contribution to neutrino masses 



modifies the values of Uj but does not affect maximal 
mixing. The second invariant, on the contrary, generates 
a non-zero off-diagonal entry in the neutrino sector which 
modifies the resulting value of #23, potentially prevent- 
ing an almost maximal mixing. However, this invariant 
cannot be mediated by £j, so in our minimal model it 
does not contribute. One can check that it is mediated 
by scalar isotriplets £ G 1,1' and/or by heavy neutrino 
states v c G 2,1,1'. Maximal mixing indicates that all 
these fields are absent or their contribution to M„ is sup- 
pressed. 



1. Remarks on the scalar VEVs (I) 

The most general S3 invariant scalar potential for $12 
is given by 

V* = m 2 ^*! + $J$ 2 ) + -v(*t*i + $2>2) 2 + 

+ _2.($t $i _ $ t $2 )2 + A 3 $t $2$ t $i _ 



Replacing with 1^*2, one can check that V<s>(vi,v 2 ) 
is bounded from below if and only if Ai + A 2 > and 
— 2Ai < A3 < 2A2. In this region of parameters, the 
absolute minimum, in the case m 2 < 0, is given by v% — 
v 2 = —m 2 / (2A1 + A3). This justifies the assumption V\ — 
v 2 made in the previous section. 

Notice that V$ is invariant under two independent 



U(l) transformations: $^2 



• 2 <I>i.2. As a conse- 



quence, electroweak symmetry breaking leaves us with 
an undesired real massless scalar, the residual Goldstonc 
boson. However, since the S3 symmetry is broken at elec- 
troweak scale, one can allow in V$ soft breaking terms 
with size comparable to the quadratic term in Ea. (ll5|) . 
This S3 explicit breaking can originate from the VEVs 
of extra fields belonging to a hidden sector of the theory, 
similarly to the soft breaking terms in supersymmetric 
models. Let us consider the extra term 



A^ = ), 2 ($l$ 2 + ^$i) ■ 



(16) 



It breaks a 17(1) symmetry since it enforces the relation 
9 1 = 8 2 . In fact, the term in Ea. Hltj|) respects the discrete 
symmetry $1 <-> $2, which is also a symmetry of the S3 
invariant potential V$. Therefore the potential obtained 
adding Eq. (|15[) and Eci. (|16|) can be still minimized by 
vi — v 2 = v, where now v = — (m 2 + rj 2 )/ '(2Ai + A3). We 
assume that this "custodial" symmetry is preserved till 
scales much smaller than electroweak. Computing the 
quadratic part of V$ + AV$ after electroweak symmetry 
breaking, one can check that all physical scalar fields take 
a mass of the order of the electroweak scale. 

The VEVs of & are induced by the VEVs via the 
following scalar potential: 



(M'iy^ki + (.\/.,,;'<^,.!yl>. 



h.c. 



(17) 
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The S3 invariant mass term, M|(£j£i +^2), is supposed 
to be very heavy, M| 3> v 2 , in order to suppress the 
triplet VEVs Ui via the usual type II seesaw mechanism 
HlHIHEl. The actual values of u x and u 2 depend on 
the scale of different trilinear couplings. The S3 invariant 
trilinear term is given by 



M w (^i$i$! + &<f>2®2) + h.c. 



(18) 



If M^00 is the dominant trilinear coupling, then in- 
tegrating out the heavy fields £, one obtains u* = 
—vfM^^/M^, so that v 1 = V2 implies u\ = u 2 . However, 
if we assume that all the soft breaking term couplings are 
smaller than or equal to the electroweak scale, where S3 
is spontaneously broken, than there is no reason to ex- 
pect that the S3 invariant trilinear coupling is dominating 
over the others. For example, if the dominant trilinear 
term is 



i=l,2 



i(£i$l$2 



h.c. 



(19) 



than one obtains 



u- = —viV^M^/M^, so that ui 
is naturally induced. Notice that Eq. l|19|) preserves the 
discrete symmetry $1 <-> $2- If this 'custodial' symmetry 
is broken only at scales much smaller than v, than it is 
natural to take M| $4 , ~ v ^> M^$$. 

Notice that the most general V£ breaks S3 only softly, 
thus not affecting the mass matrices found in the pre- 
vious section and allowing, at the same time, u\ 7^ u 2 . 
The symmetry $1 <-> $2, that preserves v± = v 2 , is some- 
what analogue to the strong isospin, which is a good ap- 
proximate symmetry at the scale Aqcd (w p « m„ ), not 
because m u w m^, but because m u , <C Aqcd- 



B. The electron sector 



Let us introduce the fields 



L e , e c , $3 G 1 



(20) 



The S3 singlet scalar isodoublet $3 is necessary to pro- 
vide a non-zero mass to the electron. The new invariants 
relevant for lepton masses are 



ee 



(21) 

Comparing the first invariant in Eq. 111|) with the first in 
Ea. (|21fl . one realizes that only one linear combination of 
[i c and e c is coupled to {r<f)\ + 71$), while the orthogonal 
is not. Since a rotation of [i c and e c is unobservable 
(right-handed) , we have the freedom to redefine e c as the 
decoupled state. Then the charged lepton mass matrix 



takes the form 




(22) 



where V3 —< 0§ > and in the last equality we have used 
vi = v 2 = v. Assuming \v\ ^> \v 3 \ (see section ITll fj 111 , 
one gets 



1/4^3 1 
V2\f: 



9 i 
'12 



l/5^3| 
V2\f: 



It! 



(23) 



If the coefficients fi are of order one, then 6 l 12 ~ nie/m^. 
The neutrino mass matrix has the following form: 



f 6 u 2 / 6 tti 
feU2 hut 
fern /3U2 



/3W2 



e f e f e v 
£/ e« 
ef€ u 1 

(24) 

Neglecting for the 

moment the small angle 9 l 12 , the symmetry basis is given 



where e/ = fe/fa and e u = u\ju 2 . 



by {fe, (^-^r)/\/2, (v^ + V T )/y/2). 

can write 



In flavor basis, one 




-V2e f (l 



(25) 

The 11-entry in M[ l is zero, thus implying a strong sup- 
pression of neutrinoless 2/3-decay. It is well known that 
this can happen only in the case of normal hierarchical 
neutrino spectrum. Therefore the parameters e/ jU have 
to be taken small and the first term in Ea. (|25() is the 
dominant /ir-block [T^j • This dominant structure of M[ l 
is the unique one allowed by data in the case of normal 
mass hierarchy ||| . We have shown that an S3 symmetry 
is suitable to generate simply the ^tr-block. 
Diagonalizing Ea. l24|) . one finds 



m 3 w I/3U2I ~ \/A 



2 

lllj atm 



7T 






4 




e}e u 


12 ' 


« 2 


!£ 



t/13 ~ 



arg e u 



Vkn| 4 + 4|e ue/ | 



(26) 

where 5 is the Dirac-type CP-violating phase in the 
standard parameterization of the lepton mixing matrix 
[57| . The correlations among different observables are 
in agreement with present data and can be tested in fu- 
ture precision measurements. Using the best fit values 
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FIG. 1: Predictions of the S3 model for the mixing angle #13. 
The gray area represents the Large Mixing Angle MSW al- 
lowed region for the parameters tan 2 #12 and Am 2 sol , stretched 
to include also the experimental uncertainty in Am\ tm . The 
best fit point is denoted with a star. The values of #13 are 
determined by #12 and Amj i/AmJ tm as described approxi- 
mately by Ea. l|27|l . Possibly large corrections to these values 
of #13 can come from charged lepton sector (see Eg. 1291 ). 



tan 26»i2 = 2.1 and Am 2 sol / Am 2 atm = 0.035 
we find |e„| w 0.12 and |e/| « 0.13, which imply 
|6» 23 - tt/4| w 0.002 and 6 13 w 0.016. 

The allowed values of #13 can be better evaluated notic- 
ing that Ea. (|26[) implies 

Am 2 , 



1 



713 



• sin 26 ) 12 - 



(27) 



Using 90% C.L. allowed ranges, we obtain the prediction 

0.008 < 9 13 < 0.032 . (28) 

Correspondingly, the parameters |e/| and |e„| are con- 
strained in the range 0.1 -j- 0.2. A numerical diagonal- 
ization of the matrix l|24|) has been performed and the 
resulting predictions for 6*13 are shown in Fig^ in good 
agreement with the approximations given in Eqs. I|27() 
and pgj. 

We have neglected till now the contribution of the 12- 
mixing in the charged lepton sector (see Eq.|(23J). Per- 
forming a careful commutation of rotation matrices, we 
find that d[ 2 affects all three observable mixing angles as 
follows: 



A' #23 



A% 3 « ^ 



A% 2 « ^ 



(29) 



V2' V2 

In the case of 13-mixing, this correction can be important 
even for 9[ 2 as small as m e /m M « 0.005. The rotation 
9[ 2 generates also 



12 I 

(30) 



which induces a non-zero (but still quite suppressed) neu- 
trinoless 2/3-decay. 

It is worthwhile to give a look to the contribution of $3 
to the five-dimensional operator L a Lp$>i$>j/Mji, which 
can perturb the neutrino mass matrix Q24[l. The possible 
53 invariants are 



&°*) 2 



( 31 ) 

The first two invariants are not mediated by £1,2 and 
therefore are absent in the minimal model. The last two 
invariants can be mediated, but their contribution can be 
absorbed into a redefinition of ux.2 and /^g in Ea. (|24() . 



1. Remarks on the scalar VEVs (II) 

Of course the introduction of the S3 singlet $3 in our 
model modifies the scalar potential discussed in section 
1111 A II The most general S3 invariant potential is 



Vz<t> = V$ 
+A6($£*a)(*l*i - 

A7$3$i$3<E>2 4 



+ m!$t$ 3 + ^($t< i , 3) 2 + 

- <J4$ 2 ) + A 6 $f($i^ + $2* 2 
A 8 $3($i$^$i + <& 2 <&\$2) + h.C 



$2* 2 ) $ 3 + 



(32) 

where is given in Ea. H15(l . 

We do not discuss, here, the general minimization 
problem (see, for instance, |58j). For our purposes, it is 
enough to verify that a solution exists with \v\\ = jfaj = 
|«| ^> \v 3 \. Assuming that all the couplings Aj are of 
the same order and barring special cancellations among 
them, we find a minimum for 



2Ai + A 3 



V 3 



2A 8 |d 3 



ml + 2\v\ 2 {\ 5 + A 6 + A 7 ) 
(33) 

where A73 are appropriate rephasing of A7 ; s, determined 
by the Vi complex phases. To satisfy the initial assump- 
tion \v%\ <C |u| is enough to choose m| » |w| 2 , so that 
\v 3 \^2\~X 8 v\(\v\ 2 / m 2 ). 

The large parameter m| determines, in first approx- 
imation, the mass of the four real scalars contained in 
$3. Since the effect of 1*3 can be safely treated as a small 
perturbation, all further considerations made in section 
1111 A II about $12 and £1.2 masses and VEVs are still 
valid. 



C. The quark sector 

Let us assign quark fields to S3 representations in exact 
analogy with leptons: 



Q2 



62, Qx, u c , c c , d c , s c £i, b c , t c e r , 

(34) 
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where Qi = (it, di) T . As for leptons, the third generation 
isosinglets are odd S3 singlets while second generation 
ones are 63 invariant. This turns out to be the origin of 
a sizable 1 — 2 mixing and a suppressed 1 — 3 mixing. 
It is straightforward to construct independent invariants 
contributing to quark mass matrices. The result is 



M d = 




(35) 



The S3 assignment of the quarks parallels that of the lep- 
tons, as shown by the analogous structure of their mass 
matrices (12211 and (|35l) . This makes our model suitable 
for a possible embedding in a Grand Unification Theory. 
It is interesting that, in a class of SO(10) inspired models 
known as "lopsided" [5^, |6(|, the almost maximal lep- 
tonic 2 — 3 mixing originates in the charged lepton mass 
matrix as in the present case. However, the pattern is dif- 
ferent in the quark sector: in our model the left-handed 
2 — 3 mixing cancels between down and up quark sectors; 
in "lopsided" models the large charged lepton mixing ap- 
pears also in the down quark mass matrix, but on the 
right-handed side, therefore it does not show up in the 
CKM matrix. 

In the limit \v\\ = \v2\ = \v\, the maximal 2 — 3 mix- 
ing cancels exactly between up and down matrices and 
we get m c /m t w \gi/g%\, m s /m b w \gf/g%\. The ex- 
perimental value, 9 23 ~ 0.04, can be explained by small 
corrections to |t>i| = \v2\, due to soft breaking and/or $3 
contributions to the scalar potential in Ea. l32fl . In fact, 
one finds the interesting sum rule 



Oil 



V4 



«2 



«1 



"2 



(36) 



Larger deviations from maximal atmospheric mixing can 
be explained only by a non-zero contribution to the mix- 
ing coming from the neutrino sector (see discussion at 
the end of section IIII A|) . 

In analogy to the charged lepton sector, after the max- 
imal 2 — 3 rotation the structure of the 1 — 2 blocks in 
Md and in M u implies 



Vz\gfi 



1 

" 20 

'12 " 



V3\ 



1 d.u 1 

m v 3\ 



V2\g?v\ 



1 

400 



V2\gi 



d.u 



The CKM mixing matrix is given by 
Uckm = U23U13U12 = 



(37) 



(38) 



where U 2 3 are almost maximal 23-rotations that can- 



cel up to the small angle given in Ea. (|36|l . while U 



12 



are the 12-rotations quantified in Ea. H37|) . From the 
commutation of £/" 2 and U 23 , a 13-mixing is generated: 
°13 ~ °i2 l3- One has to fit Qf 3 w 0.004 and the Cabibbo 
angle B\ 2 ~ 0.22, which results from the combination of 
and Uf 2 . Looking at Ea. I|^7fl . one realizes that the 
fit is successful for \va/v\ ~ 0.1 and the coefficients g^' d 
of order one. However, a significant suppression of g% is 
required to match the smallness of the up quark mass. 
We will suggest an explanation for this suppression in 
the next section. 



IV. DISCUSSION AND CONCLUSIONS 

We have analyzed the problem of constructing a maxi- 
mal 2 — 3 mixing in the lepton sector. As shown in section 
ITT1 minimal models with Abelian flavor symmetries give 
a defective description of neutrino oscillation data. We 
have then constructed a model based on 53 flavor sym- 
metry which generates naturally maximal 2 — 3 mixing. It 
contains only Standard Model particles plus an enlarged 
scalar sector, formed by three isodoublets at electroweak 
scale and two much heavier isotriplcts. 

Let us summarize the ingredients of the model: 

• Second and third generation fermion isodoublets 
transform as an 63 doublet. 

• Second generation fermion isosinglets are S3 invari- 
ants while the third ones transform as odd S3 sin- 
glets. 

• The two scalar isodoublets which generate the 2 — 3 
block of charged fermion mass matrices have the 
same VEV, while the one giving mass to first gen- 
eration fermions takes a much smaller VEV. 

• The neutrino mass matrix is generated by an S3 
doublet of heavy scalar isotriplets, which have tiny 
and different VEVs. 

As a consequence, maximal 2 — 3 mixing is induced in 
the charged fermion mass matrices, while the 2 — 3 block 
is diagonal in the Majorana mass matrix of neutrinos. 
Therefore, a maximal mixing results in the lepton sec- 
tor, whereas complete cancellation takes place between 
up and down quark mixing. Small corrections in both 
sectors are allowed and they are correlated as in Eq. (|30H • 
Extra deviation from maximal atmospheric mixing can 
appear if heavy fields other than the two isotriplets give 
a subdominant contribution to the neutrino mass matrix. 
The ratio between second and third generation masses is 
not determined by the S3 symmetry. However S3 distin- 
guishes the two corresponding sets of couplings, which 
are of the type 2x2x1 and 2 x 2 x 1' for second and 
third generation respectively. This suggests that the hi- 
erarchy between the two types can be induced by extra 
flavor structure to be added to our minimal model. 

The spectrum of neutrinos is with normal hierarchy. 
In flavor basis the neutrino mass matrix has a dominant 
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/ir-block. The 1 — 2 mixing can be naturally of order one, 
thus explaining the Large Mixing Angle MSW solution of 
the solar neutrino problem. The 1 — 3 mixing is correlated 
with solar parameters by Eci. (|27[) and turns out to be 
about 0.02. 

The neutrinoless 2/3-decay is strongly suppressed. If 
the recent claim [§lj of neutrinoless 2/3-decay were con- 
firmed, then |(M„)ii| > 0.1 eV and our model would be 
ruled out, unless the dominant mechanism of the decay 
is not the exchange of the light Majorana neutrinos |62j . 
Notice that in our model the suppression of (M„)n is in- 
duced by the requirement to obtain an atmospheric mix- 
ing close to maximal. In fact, one can check that, adding 
£ € 1,1' and/or v c 6 2,1,1' to the model, a non-zero 
contribution to (Af„)n is accompanied by a contribution 
of the same order to (M u )23, which tends to cancel the 
maximal 2 — 3 mixing coming from charged leptons. 

In the quark sector, a small 1 — 2 mixing is gener- 
ated naturally because u and c c (d and s c ) are both S3 
invariants, thus allowing a sizable 12-entry in the mass 
matrices. One can reproduce easily the Cabibbo angle. 
The different S3 assignment of t c and b c (odd S3 singlets) 
suppresses the 1 — 3 mixing in M4 and M u ; the resulting 
CKM matrix contains 9l 3 ~ ^12^231 m agreement with 
data. 

First generation masses are suppressed by the small ra- 
tio of scalar VEVs |i<3/k|. This ratio cannot be too small 
since the Cabibbo angle is correspondingly suppressed. 
In particular the smallness of the u quark (electron) mass 
indicates an extra source of suppression. This can be eas- 
ily obtained, for example, introducing a Z2 parity leaving 



all fields invariant but u c (e c ), which is Z2 odd. It is easy 
to check that, in the limit of exact Z2 symmetry, m u (m e ) 
is forbidden. 

The model can be tested in the near future by 

• precision measurements of neutrino oscillation pa- 
rameters; 

• upper bounds on neutrino masses from cosmology, 
tritium /3-decay and neutrinoless 2/3-decay; 

• direct investigation of the scalar isodoublet sector 
at LHC; 

• flavor violating decays mediated by the scalars. 

A detailed study of the phenomcnological implications of 
the model is left for future work. 

In conclusion, S3 is the smallest flavor symmetry group 
which can explain in a minimal way the maximal atmo- 
spheric mixing. The required structure in the lepton 2 — 3 
sector enforces in a straightforward way the whole struc- 
ture of three generation lepton and quark mass matrices. 
These matrices are suitable to explain all current data. 
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